Processing Distributed Compoud-Data Streams
نویسندگان
چکیده
In the environment of distribute data stream systems, the available communication bandwidth is a bottleneck resource. It is significant to reduce the communication overhead as possible for improving the availability of communication bandwidth with the constraint of the precision of queries. In this paper, we propose a new method for transferring data streams in distributed data stream systems, named as compound-data streams. The idea is that raw data streams are grouped and merged into compound-data streams, and then compound-data streams, instead of raw data streams, are transferred to the central processor node. By this way, the communication overhead can be reduced greatly.
منابع مشابه
Distributed Resource Allocation for Stream Data Processing
Data streaming applications are becoming more and more common due to the rapid development in the areas such as sensor networks, multimedia streaming, and on-line data mining, etc. These applications are often running in a decentralized, distributed environment. The requirements for processing large volumes of streaming data at real time have posed many great design challenges. It is critical t...
متن کاملSynergy: Sharing-Aware Component Composition for Distributed Stream Processing Systems
Many emerging on-line data analysis applications require applying continuous query operations such as correlation, aggregation, and filtering to data streams in real-time. Distributed stream processing systems allow in-network stream processing to achieve better scalability and quality-of-service (QoS) provision. In this paper we present Synergy, a distributed stream processing middleware that ...
متن کاملAnswering queries over incomplete data stream histories
Streams of data often originate from many distributed sources. A distributed stream processing system publishes such streams of data and enables queries over the streams. This allows users to retrieve and relate data from the distributed streams without needing to know where they are located. Stream data is important not only for its current values but also for past values produced. In order to...
متن کاملComplex Event Processing over Distributed Uncertain Event Streams
In the 21st century, as technologies of perceptual recognition develops, devices of information generation begin to accurately sense, measure and monitor the physical world in real time.Complex Event Processing(CEP), which can be used to extract user level information from raw data, becomes the key part of the IoT middleware. Most of the current study of complex event processing has not focus o...
متن کاملA Study on Distributed Frequent Co-occurrence Patterns Algorithms across Multiple Data Streams
With the era of big data coming, the data streams are fast, continuous, and unbounded. The real-time requirements of the data streams processing results are very high. A large number of researches have been on Frequent Co-occurrence Patterns across multiple data streams. But those algorithms are centralized, which is worked on a single compute node. The memory of a single compute node and CPU c...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2004